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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments with respect to claims 90-121 have been considered but 
are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 90-93, 95-101, 103-109, 111-117, and 119-121 are rejected under 35 
U.S.C. 103(a) as being unpatentable over U.S. Patent Application Publication 
2001/0023436 to Srinivasan et al. (Srinivasan) in view of U.S. Patent 6,006,265 to 
Rangan et al. (Rangan). 

Regarding claims 90 and 106, Srinivasan teaches an authoring system (fig. 7, 
label 51 ), for generating image tracking data for overlaying information onto objects of a 
video stream (pg. 4, para. 0051-0052, pg. 7, para. 0085), which reads on a mask 
generator generating a mask including graphics data for overlaying a graphic image on 
a video frame, wherein the image is associated with a video object. The authoring 
system of Srinivasan provides object data associated with the object in order to track 
the image, wherein the data includes annotations, such as icons, graphics, text to be 
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linked to one of a plurality of program stream (pg. 2, para. 0018, pg. 7, para. 0085), 
which equates to an annotation source providing object data associated with the video 
object, the object data including an indicia indicative that the video object is linked to 
one of the plurality of multiplexed program streams, and an identifier for a particular one 
of the plurality of multiplexed program streams. Srinivasan teaches an encoder to 
encode the mask and object data into the television stream (pg. 2, para. 0018, pg. 8, 
para. 0091, 0096). Srinivasan teaches a broadcaster, which inherently has a 
transmitter, in that Srinivasan teaches broadcasting the signal and the plural streams to 
receivers (fig. 8, label 47, pg. 7, para. 0087). Srinivasan teaches a receiver (fig. 9) 
combining and video with the annotation stream (pg. 12, para. 0134) the displaying the 
streams on display module (pg. 12, para. 0137, fig. 12, label 139) (which equates to 
capable of retrieving and overlaying the image on the frame), Srinivasan teaches 
receiving user input (which reads on capable of receiving viewer actuation of the 
graphic image) (pg. 12, para. 0138). However, Srinivasan is silent on reviewing the 
indicia in the object to determine whether the object is linked to one of the program 
streams, and in response to determining that the object is linked to one of the program 
streams, switching from the current program stream to presenting the particular one of 
the program streams. In analogous art, Rangan teaches hotspots and associated 
hyperlinks (col. 24, II. 61-65), wherein when the user clicks on a hotspot, the system 
may branch to a web-page or alternatively to another video (col. 27, II. 52-65), which 
reads on reviewing the indicia in the object to determine whether the object is linked to 
one of the streams and in response to determining that the object is linked to one of the 
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program streams, switching from the current program stream to presenting the 
particular one of the program streams. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Srinivasan by reviewing the indicia in the object 
to determine whether the object is linked to one of the program streams, and in 
response to determining that the object is linked to one of the program streams, 
switching from the current program stream to presenting the particular one of the 
program streams as taught by Rangan in order to facilitate navigation to different 
programs and accessing desirable information to the user. 

Regarding claims 98 and 114, Srinivasan teaches an authoring system (fig. 7, 
label 51), for generating image tracking data for overlaying information onto objects of a 
video stream (pg. 4, para. 0051-0052, pg. 7, para. 0085), which constructs a mask 
including graphics data for overlaying a graphic image on a video frame, wherein the 
image is associated with a video object and object data, which is received by the 
receiver (fig. 12, pg. 11-12, para. 0132), which inherently has a tuner in order to 
demodulated the signals for the broadcaster. The authoring system of Srinivasan 
provides object data associated with the object in order to track the image, wherein the 
data includes annotations, such as icons, graphics, text to be linked to one of a plurality 
of program stream (pg. 2, para. 0018, pg. 7, para. 0085), which equates to providing 
object data associated with the video object, the object data including an indicia 
indicative that the video object is linked to one of the plurality of multiplexed program 
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streams, and an identifier for a particular one of the plurality of multiplexed program 
streams. Srinivasan teaches a decoder to decode the mask and object data from the 
television stream ((pg. 12, para. 0137, fig. 12, label 139). 

Srinivasan teaches a broadcaster, which inherently has a transmitter, in that 
Srinivasan teaches broadcasting the signal and the plural streams to receivers (fig. 8, 
label 47, pg. 7, para. 0087). Srinivasan teaches a receiver (fig. 9) combining and video 
with the annotation stream (pg. 12, para. 0134) the displaying the streams on display 
module (pg. 12, para. 0137, fig. 12, label 139) (which equates to capable of retrieving 
and overlaying the image on the frame), Srinivasan teaches receiving user input (which 
reads on capable of receiving viewer actuation of the graphic image) (pg. 12, para. 
0138). However, Srinivasan is silent on reviewing the indicia in the object to determine 
whether the object is linked to one of the program streams, and in response to 
determining that the object is linked to one of the program streams, switching from the 
current program stream to presenting the particular one of the program streams. In 
analogous art, Rangan teaches hotspots and associated hyperlinks (col. 24, II. 61-65), 
wherein when the user clicks on a hotspot, the system may branch to a web-page or 
alternatively to another video (col. 27, II. 52-65), which reads on reviewing the indicia in 
the object to determine whether the object is linked to one of the streams and in 
response to determining that the object is linked to one of the program streams, 
switching from the current program stream to presenting the particular one of the 
program streams. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Srinivasan by reviewing the indicia in the object 
to determine whether the object is linked to one of the program streams, and in 
response to determining that the object is linked to one of the program streams, 
switching from the current program stream to presenting the particular one of the 
program streams as taught by Rangan in order to facilitate navigation to different 
programs and accessing desirable information to the user. 

Regarding claims 91, 99, 107, and 115, Srinivasan teaches the presented 
program stream is a video stream (pg. 8, para. 0091). 

Regarding claims 92, 100, 108, and 116, Srinivasan teaches the presented 
program stream is an audio stream (pg. 8, para. 0091). 

Regarding claims 93, 101 , 109, and 117, Srinivasan teaches the graphics image 
is overlaid on the video object (pg. 4, para. 0052). 

Regarding claims 95, 97, 103, 105, 111, 113, 119, and 121. Srinivasan teaches 
the television broadcast signal as MPEG which is a digital signal (pg. 8, para. 0091). 

Regarding claims 96, 104, 112, and 120, Srinivasan teaches the television 
broadcast signal is an analog signal (pg. 8, para. 0091). 
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4. Claims 94, 102, 110, 118 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over U.S. Patent Application Publication 2001/0023436 to Srinivasan et al. 
(Srinivasan) and U.S. Patent 6,006,265 to Rangan et al. (Rangan) in view of U.S. 
Patent 6,452,598 to Rafey et al. (Rafey). 

Regarding claims 94, 102, 1 10, 1 18, Srinivasan teaches is silent on a receiver is 
further capable of determining whether the video object is visible in the video frame and, 
responsive to a determination that the video object is visible in the video frame, 
overlaying the graphics image on the video frame. 

In analogous art, Rafey teaches interfacing 3-D graphics content with broadcast 
video, wherein the system transmits a mask and timing information (via a timelist) for 
the video to implement shaped video effects and the viewer device renders to make the 
appropriate regions visible to the user (col. 8, II. 39-50), which equates to receiver is 
further capable of determining whether the video object is visible in the video frame and, 
responsive to a determination that the video object is visible in the video frame, 
overlaying the graphics image on the video frame. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Srinivasan by using a receiver that is further 
capable of determining whether the video object is visible in the video frame and, 
responsive to a determination that the video object is visible in the video frame, 
overlaying the graphics image on the video frame as taught by Rafey in order to 
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incorporate interactive graphics into the digital broadcast content to greatly enrich the 
viewers' experience (Rafey: col. 1, II. 46-50). 



Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Andrew Y. Koenig whose telephone number is (571 ) 

272- 7296. The examiner can normally be reached on M-Th (7:30 - 6:30). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Christopher Grant can be reached on (571) 272-7294. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 

273- 8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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